Feb 23
1
Gary Illyes from Google posted a new PSA on LinkedIn saying that the most common reason a site unexpectedly blocks Googlebot from crawling is due to a misconfiguration of a firewall or CDN.
Read the original post:
Google: Firewalls or CDNs Issues Are The Most Common Reason For Blocking Googlebot